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T*'^  ''^lidacion  of  USAFA  selection  tests  has  been  a  |oint  project  of  the 
Academy  and  the  Personnel  Research  Laboratory  since  admission  of  tiie  inittal 
class  of  1959.  The  Academy  develops  the  Selection  Battery  and  collects  the 
data.  The  Laboratory  develops  experimental  rest  batteries,  carries  out  data 
reduction  and  analysis,  and  reports  the  results  for  each  entering;  class  of  cadet 
Previous  reports  cover  classes  1959  throu/jh  196L 


MM  K  M  T 

Applicant--  for  each  Air  Force  Academy  c'ass  cake  a  battery  of  selectii  i 
teits  to  i-Mabii.'.ii  :J.rir  l  otering  cadets  take  an  additioni'  hatrery 

consisting  mainly  of  nonacademic  experimental  tests,  developed  as  part  of  a  pro¬ 
gram  for  the  production  of  officer  selection  and  classification  devices.  Hoth 
batteries  are  validated  at  the  end  of  the  fourth  class  ye.^r  against  arademir  and 
nonacademic  criteria.  In  the  class  of  1964  the  criteria  were  the  Academic  .Standard 
.Score,  6adct  Kffecti veness  Racing  ((iFR),  Rcsiduali/ed  (.adet  Fffectiveness  Rating 
(with  rcspiect  to  physical  .■ptitude),  F.xtracursricular  Activities  Standard  Score,  N.  n- 
academic  Standard  Soire,  and  Harly  Motivational  Flimination.  I 'sing  multiple  re¬ 
gression  techniques,  it  was  found  that  there  are  measures  in  both  the  selection  and 
experimental  batteries  having  validity  for  each  of  the  criteria.  Multiple  correlations 
up  to  .(i^  were  obtained  with  the  Academic  score  as  the  criterion,  and  up  to  .M 
with  the  <  KR.  Naliditits  are  not  significantly  different  from  those  ob.setvcd  in  the 
class  of  l‘Mi'  for  selection  tests  common  to  both  classes.  Previously  observed 
fluctuating  v.ilidities  appear  to  have  stabilized. 


Tl.ts  report  has  been  reviewed  ai>d  is  appic-ed. 
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I.  l‘ltOIII.I  \l 

I'^.ich  vr.ir  a  b.itfcrv  of  (-xi'rriniciU.il  is  .itimnistc-rcsl  to  the-  t-ntcrin^;  i  I.iss  .it  the 

Alt  l  oree  .At.iilrmv.  I'hi  sf  b.itteties  .ire  p.irt  of  .1  researih  .iml  ilfvfh'pmrnt  pfo|;fam  for  tiir 
[>foilustion  of  offiift  sflfition  arnl  i  i.issif  it  .ition  tests.  During;  the  sj-vt-ral  yrars  of  this  (>ro- 
gram  at  the  .At  ailemv.  thesT  has  heeri  an  increasing  tendenc  v  to  consttuc  t  the  batteries  primarilv 
from  tests  which,  on  empirical  tir  theoretic  al  jtrounils.  were  beneveilto  have  valiilitv  as  predic¬ 
tors  of  nonacademic  vriteria.  Ihe  nonacademic  iriteria  of  jjreatesi  interest  h.ive  generally 
been  the  (  adet  blffec  liveiu-ss  Rating  ((  |{k)  i*t  its  et^ui  v.ileiit .  and  l-.atly  .Motivational  l.limin.i- 
tion  from  the  Ac.idemv.  Some  tests  .ire  int  ludeif  in  the  exjH-rimental  b.itteries  primarily  tt> 
prtivnie  data  from  which  the  new  class  may  be  characterized  in  terms  of  selected  variables. 

Scores  vierived  from  c.ich  experimental  hattetv  are  validated  when  the  •iesired  criterion 
d.iia  h.ive  become  .iv.iiiable.  Ordinarily,  the  criteria  used  are  those  which  mature  approximately 
one  year  after  the  test  administration.  The  ultimate  ob|ective  of  these  v.ilidation  studies  is  to 
locate  test  items  and  scales  which  have  sufficient  promise  to  warta-nt  further  development  toward 
possible  selection  uses,  either  at  the  .Air  Force  Academy  c'niv  or  /jeneiallv  throu/thout  the  .Air 
Force.  Routinely,  the  selection  test'  ,;.5^tni.stered  by  the  .Academy  to  candid.ites  for  admission 
are  included  in  the  validation  studies. 

The  present  report  is  concerned  with  'he  predictive  validities  of  both  the  selection  and 
experimental  batteries  administered  to  the  Air  Force  Academy  class  of  l‘)f>.t.  The  criteria  are 
those  which  matured  at  the  end  of  the  fourth  class  (freshman)  year  l«*i  this  class.  iTiey  include 
the  academic  averajte  and  a  variety  of  nonacademic  criteria,  some  of  which  have  not  been  pre¬ 
viously  reported  in  this  senes. 


2.  MF  IIHNf 

The  experimental  test  battery  was  administered  to  new  cadets  in  the  c  lass  of  Dh>4  within 
a  few  days  of  arrival  at  the  Academy.  The  selection  tests  had  been  previously  administered 
at  examining  centers  ii»  applicants  few  admi.ssion  to  the  class.  Scenes  from  both  batteries  were 
collated  with  the  criterion  data  at  the  end  cd  the  fourth  class  year,  and  procluct  moment  corre¬ 
lation  coefficients  were  computed  between  each  predictor  and  criirrt<>n.  Oik  of  the  ctiietia, 
Fiarly  Motivational  Flimination.  was  actually  a  dichotomy’  of  retainees  vs  early  motivational 
eliminees.  Validities  against  this  criterion  look  the  form  of  point -bi serial  cortelaiions.  Means 
and  standard  iieviaiic>.  s  isf  each  predictor  and  criterion  were  computed,  and  all  criteria  were 
intercorreiated  except  Fatly  Motivational  F.limination.  This  was  excluded  because  none  of 
the  early  eliminee  group  had  scores  in  other  criterion  variables. 

The  class  of  I9(>4  iniiiallv  cotMained  7R6  cadets,  including  I  A  turnbacks  from  previous 
classes.  In  validating  predictors  against  each  criterion  except  Fatly  Motivational  Flimination. 
only  cadets  with  complete  ptedictcv  and  ctitetion  data  were  included.  This  opetation  ;rduced 
the  number  of  cases  for  study  to  49A.  In  validating  predictors  against  Fatly  Motivational 
Flimination.  cases  were  not  excluded  solely  because  they  lacked  other  cfiieti.in  data,  but  all 
cases  eliminated  from  the  Academy  for  nonmoiivaiionai  reasons,  and  cases  lacking  complete 
predictor  data,  were  excluded.  Thus  in  the  validaiion  against  Fatly  Motivational  Flimination. 
there  were  616  cases  available  for  study,  of  which  121  were  early  morivational  eliminees. 
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In  addition  to  computing  product  moment  correlations  between  predictors  and  criteria,  a 
number  of  multiple  linear  regression  analysts  were  performed.  These  yielded  multiple  corre¬ 
lation  coefficients  between  selected  sets  of  predictors  and  criteria,  the  squares  of  these 
coefficient  .,  and  standard  partial  regression  coefficients  for  the  predictors.  Variables  were 
c  hosen  for  inclusion  in  the  analyses  in  such  a  way  that  their  unique  and  valid  contribution  to 
rht  t  al  predicted  criterion  variance  could  be  determined  in  the  context  of  other  predictors. 
Most  analyses  were  designed  cither  to  show  the  contribution  of  experimental  predictors  in 
contexts  primarily  of  selection  tests,  or  to  show  the  contribution  of  the  Ait  Fotce  Officer 
Qualifying  Test  (AFQT),  a  selection  test,  in  contexts  primarily  of  other  selection  tests.  At 
the  time  the  analyses  were  designed,  the  utility  of  the  AFOQT  in  the  selection  battery  was 
being  questioned. 

The  method  of  resting  the  unique  and  valid  contribution  of  sets  of  predictors  by  multiple 
regression  analyses  has  been  described  in  detail  by  Bottenberg  &  Ward  (1963).  Briefly,  the 
squared  multiple  validity  coefficient  of  a  full  set  of  predictors  is  compared  with  the  squared 
coefficient  of  a  subset  of  these.  A  hypothesis  specifics  rhat  the  regression  weights  of  all 
predictors  in  the  full  set  but  not  in  the  subset  are  zero.  The  hypothesis  is  rejected  if  the 
value  of  the  test  statistic  F  exceeds  the  value  which  cuts  off  a  specified  proportion  of  the 
area  under  the  F  distribution.  For  the  present  analyses,  the  proportion  was  specified  as  .01. 
Rejection  of  the  hypothesis  implies  that  at  least  one  variable  in  the  full  set  but  not  in  the 
subset  h.4S  a  nonzero  regression  weight  in  the  context  of  the  subset.  The  full  set  need  not 
contain  all  the  variables  under  study  in  relation  to  a  given  criterion. 

:i.  VARIABLKS 


Selection  Variables 

The  selection  variables  are  essentially  the  same  as  those  used  in  selecting  ptevious 
Academy  classes.  One  of  these  variables,  the  AFOQT,  is  the  instrument  used  throughcLi;  the 
Air  Force  in  officer  selection  and  classification  programs.  The  form  administered  as  a  se¬ 
lection  test  for  the  Academy  class  of  1964,  Form  G,  yields  five  standard  aptitude  scores  and 
four  interest  scores.  In  addition,  the  test  yields  a  special  aptitude  score  used  only  in  the  Air 
Force  Academy  selection  program.  This  is  the  Airmanship  composite  and  is  the  only  AFOQT 
variable  weighted  into  the  final  selection  composite  for  Academy  cadets. 

The  principal  academic  predictors  in  the  selection  battery  are  the  College  Entrance 
Examination  Board  (C'EEB)  tests  and  High  School  Rank.  The  sum  of  the  CT'EB  Verbal  Aptitude 
and  English  Ciomposition  tests  constitutes  the  CJEEB  Verbal  ('omposite,  while  the  sum  of  the 
Mathematics  Aptitude  and  Intermediate  or  Advanced  Mathematics  tests  constitutes  the  CEiEB 
Quantitative  Composite.  Both  composites  are  actually  used  in  selection,  as  we!l  as  the  single 
tests.  Examinees  are  given  the  option  of  taking  either  the  intermediate  or  advanced  level  of 
the  mathematics  achievement  test,  but  in  the  validation  study  no  distinction  was  made  between 
the  two  levels.  High  School  Rank  is  the  rank  in  the  high  school  graduating  class,  with  adjust¬ 
ments  for  the  size  of  the  high  school  class  and,  in  some  cases,  for  college  or  preparatory 
school  work  completed  following  high  school. 

An  important  nonacademic  selection  test  is  the  Physical  Aptitude  Examination  (PAE). 
This  is  a  measure  of  physical  strength,  coordination,  and  agility  through  the  use  of  pushups, 
shuttle  runs,  vertical  jumps,  and  si.nilat  performances  administered  individually  under  stand¬ 
ardized  conditions.  Other  s’onacademic  selection  meai’ires  are  the  Athletic  and  Nonathletic 
Activities  Indexe.s.  These  are  inventories  of  participation  in,  and  recognition  for,  extracurric¬ 
ular  activities  while  in  high  school. 


The  Airmanship  composite,  CEEB  rests  and  •'omposites,  High  School  Rank,  and  the 
various  nonacademic  predictors  are  weighted  and  combined  to  form  the  Examination  Composite, 
which  is  used  tc  establish  an  overall  order  of  merit  at  the  time  of  selection.  The  components 
of  this  composite  and  their  weights  are  identical  with  those  in  the  class  of  1963.  Adjustments 
are  finally  made  in  the  Examination  Composite  by  a  panel  of  rating  officers,  but  diese  adjust¬ 
ments  are  not  included  in  the  variable  as  reported  here. 

Age  has  been  included  as  an  additional  selection  variable  because  age  limits  are  imposed 
as  a  requirement  for  selection.  Within  these  limits,  however,  age  does  not  function  as  a  selec¬ 
tion  variable.  Age  is  reported  in  years.  The  standard  aptitude  and  interest  variables  of  the 
AFOQT  are  reported  in  raw  score  form.  All  other  selection  variables  are  reported  as  standard 
scores  or  sums  of  standard  scores.  The  standard  sctM^e  scale  used  has  a  mean  of  300  and  a 
standard  deviation  of  100. 

Kxperimenlal  Variables 

The  experimental  variables  are  reported  in  raw  score  form.  Data  on  Years  of  College 
were  collected  during  the  experimental  testing  sessions.  Attendance  at  an  Academy  prepara¬ 
tory  school  was  excluded  from  consideration.  Data  on  prior  college  attendance  were  also 
collected  during  the  selection  process  to  permit  adjustments  which  might  be  desired  in  the 
High  School  Rank.  However,  no  prior  college  work  is  required  for  admission. 

Among  the  experimental  predictors  are  two  commercial  personality  tests,  both  of  which 
have  been  administered  to  previous  classes.  One,  the  Edwards  Personal  Preference  Schedule 
(EPPS),  is  a  forced  choice  instrument  measuring  16  variables  derived  from  Murray’s  system  of 
manifest  needs.  The  other,  the  Gordon  Personal  Profile  (GPP),  is  a  brief  measure  of  character¬ 
istics  known  to  be  important  to  good  adjustment  in  a  variety  of  social  and  educational  situa¬ 
tions.  An  interaction  variable  was  generated  from  one  of  the  scales  of  this  test  and  the  PAE. 
Such  an  interaction  accounted  for  a  relatively  large  proportion  of  the  predicted  variance  in  the 
Cadet  Effectiveness  Rating  when  studied  in  an  earlier  class  (Creager  &  Miller,  1961). 

Another  personality  measure  used  in  the  experimental  battery  is  the  Self  Insight  Test. 

This  test  was  developed  as  an  indirect  measure  of  leadership  ability  through  an  assessment 
of  personal  strengths  and  weaknesses.  Items  were  derived  from  lists  of  strengths  and  weak¬ 
nesses  collected  from  cadets  in  the  class  of  1961. 

An  additional  test  category  in  the  experimental  battery  is  the  biographical  inventory. 

One  such  instrument,  the  Officer  Effectiveness  Inventory  (OEI),  contains  biographical  and 
self-descriptive  items  resembling  those  in  biographical  subtests  of  the  AFOl^T.  The  items 
are  concerned  with  interests,  preferences,  and  past  experiences.  The  test  yields  nine  subiest 
scores  and  a  total  score  which  is  generated  from  weighted  subtests. 

Another  inventory  in  the  experimental  battery  is  the  High  School  Activities  Inventory 
(HSAI).  This  instrument  is  used  as  a  class  characterization  device  with  which  data  can  be 
accumulated  for  public  relations  purposes  and  for  counseling  Academy  applicants.  It  is  also 
processed  to  yield  scores  in  athletic,  nonathletic,  and  total  extracurriculai  activities  engaged 
in  while  in  senior  high  school.  In  content,  it  resembles  the  selection  Activities  Indexes.  The 
revised  scores  for  the  HSAI  are  weighted  to  approximate  the  Activities  Indexes.  The  original 
HSAI  scores  are  weighted  by  number  of  years  of  participation. 

The  Cadet  Personnel  Inventory  ((^PI)  and  Answer  Sheet  Marking  (ASM)  may  be  regarded 
as  a  sub-battery  of  experimental  tests.  The  former  is  a  new  consolidation  of  items  and  scales 
from  tests  which  proved  valid  for  the  prediction  of  C.adet  Effectiveness  Ratings  in  earlier 
classes.  The  Commonality  scale  is  taken  from  the  Air  Force  Preference  Inventory,  the 
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Dependency  and  Heteronomy  scales  are  from  the  Pensacola  Z  Survey,  and  the  CER  scale  is  a 
collection  of  mainly  biographical  items  from  several  sources.  Answer  Sheet  Marking  resembles 
a  conventional  rest  of  routine  clerical  facility,  but  its  scores  are  interpreted  as  a  measure  of 
carefulness.  In  the  class  of  1961  it  showed  validity  as  a  predictor  of  Cader  Effectiveness 
Ratings  (Creager  &  Miller,  I960).  These  two  instruments  represent  the  early  stages  of  a  sub¬ 
battery  in  which  valid  predictors  of  Cadet  Effectiveness  Ratings  from  all  previous  experimental 
batteries  are  being  brought  together  for  possible  future  selection  use.  These  tests  are  referred 
to  below  as  the  CPI-ASM  sub-battery. 

Another  sub-battery  administered  to  the  class  of  1964  is  composed  of  the  Color-Form, 
Design  Preference,  Dot  Estimation,  Word  Knowledge,  and  Self  Crediting  tests.  These  make  up 
a  loosely  organized  sub-battery  of  tests  having  in  common  the  objective  of  measuring  factors 
which  are  fairly  well  established  in  the  psychological  literature  The  criteria  in  the  present 
validation  study  may  not  be  the  most  appropriate  for  them. 

Color-Form  is  a  series  of  three  booklets  calling  for  recognition  responses  to  colored 
circles,  to  names  of  colors,  and  to  names  of  colors  printed  in  inappropriately  colored  ink.  The 
booklets  are  always  presented  in  a  fixed  order,  and  the  set  established  by  the  first  two  is 
presumed  to  create  a  stressful  situation  for  responding  to  the  third.  Each  booklet  is  separately 
scorable.  The  score  for  the  third  (Color-Form  C)  is  regarded  as  a  measure  of  ability  to  perform 
under  stress.  The  test  is  further  interpreted  as  a  measure  of  the  neatness-re.sponsibility  factor. 

The  Design  Preference  Test  consists  of  geometric  designs  of  varying  complexity,  pre¬ 
sented  in  groups  of  eight.  The  examinee  chooses  the  design  he  likes  best  from  each  group. 

It  is  assumed  that  examinees  whose  personality  structures  are  complex,  creative,  and  open 
to  unresolved  experiences  will  tend  to  prefer  the  more  complex  designs.  The  score  is  inter¬ 
preted  as  a  measure  of  complexity. 

Dot  Estimation  and  Word  Knowledge  are  measures  of  decisiven'’..s.  This  measurement 
is  accomplished  by  requiring  the  pierformance  of  tasks  which  are  impossible  under  the  conditions 
of  testing.  Dot  Estimation  requires  discrimination  between  pairs  of  panels  in  terms  of  which 
member  of  the  pair  contains  the  greater  number  of  dots.  Each  panel  has  about  the  .same  number 
of  dots,  and  counting  of  dots  i-  precluded  by  the  time  limits.  Word  Knowledge  is  presented  as 
a  traditional  vocabulary  test,  but  there  is  no  basis  for  choosing  a  correct  alternative.  Both 
tests  are  scored  in  terms  of  the  number  of  items  attempted,  and  the  scores  are  interpreted  as 
measures  of  willingness  to  commit  one’s  self  to  an  answer  quickly. 

The  Self  Crediting  Test  consists  of  three  brief  numerical  rea.soning  subtests  of  increasing 
difficulty.  A  conventional  numerical  ability  score  may  be  obtained  from  each  and  from  the  sum 
of  all  three.  In  addition,  a  Risk  score  is  obtained  from  each  and  from  the  total.  This  is  ac¬ 
complished  by  requiring  the  examinee  to  *’bet”  from  1  to  *)  points  on  each  subtest.  Each 
correctly  answered  item  is  then  weighted  into  the  subtest  score  according  to  the  number  of 
points  risked.  For  each  incorrect  item,  the  same  number  of  points  is  subtracted  from  the  ex¬ 
aminee’s  score  on  that  subtest.  The  weighted  scores  are  interpreted  ,is  a  measure  of  a  risk 
factor  or  of  self-confidence. 

An  additional  experimental  measure  validated  in  the  class  of  1964  is  the  CER  Prediction 
C'.omposite.  This  is  a  weighted  composite  of  PAE,  GPP  Responsibility.  CPI  c;ommunality, 

CPI  Heteronomy,  and  Answer  1  heet  Marking  scores.  The  weights  arc  approximately  the  mean 
raw  score  weights  obtained  in  multiple  linear  regression  analyses  involving  these  variables 
in  two  or  more  previous  classes.  This  composite  may  here  be  regarded  as  a  cross  validation 
of  the  system  containing  these  predictors  and  having  the  Cadet  Fiffectiveness  Rating  as  the 
criterion. 
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Criteria 

The  Academic  Standard  Score  is  the  total  of  quality  points  earned  during  the  fourth  class 
year  in  standard  score  form.  All  courses  for  which  numerical  grades  were  assigned  are  included 
in  this  criterion. 

The  Cadet  Effectiveness  Rating  (CER)  is  a  measure  of  performance  in  the  military  affairs 
of  the  Cadet  Wing.  Each  cadet  is  rated  b^'  all  other  members  of  his  squadron  who  are  in  his 
class  or  classes  senior  to  his.  These  ratings  are  averaged,  and  the  average  is  combined  with 
a  similar  rating  by  his  Air  Officer  Commanding.  This  composite  is  converted  to  a  standard 
score  metric  to  yield  the  final  CER.'  Ratings  are  in  the  areas  of  attitude,  performance  of 
duty,  leadership  ability,  and  bearing  and  dress.  The  Residualized  CER  is  a  new  criterion 
generated  from  the  CER  by  removing  the  variance  which  is  predictable  from  the  PAE.  This 
criterion  is  thus  a  measure  of  cadet  effectiveness  apart  from  the  influence  of  physical  aptitude. 
This  Residualized  CER  is  the  only  criterion  of  which  the  Academy  makes  no  current  use. 

The  Extracurricular  Activities  Standard  Score  is  a  nonacademic  criterion  of  some  interest 
because,  in  a  service  academy  setting,  extracurricular  participation  is  taken  as  an  important 
indicator  of  leadership  performance.  The  score  is  determined  by  assigning  weights  to  various 
recognized  activities  in  proportion  to  their  judged  contribution  to  the  status  or  welfare  of  the 
Cadet  Wing.  Each  cadet  is  graded  on  a  4-point  scale  for  his  performance  in  each  such  activity. 
His  score  is  the  sum  of  the  products  of  his  hours  of  participation,  grades,  and  weights  for  the 
activities  in  which  he  is  involved.  The  score  thus  determined  is  finally  converted  to  standard 
score  form.  The  sum  of  this  score  and  the  CER  standard  score  constitutes  the  Nonacademic 
Standard  Score. 

The  Early  Motivational  Elimination  criterion  is  more  fully  described  as  a  dichotomy: 
retention  vs  early  motivational  elimination.  This  criterion  was  scored  /  for  retention  and  0 
for  early  motivational  elimination.  Cadets  eliminated  from  the  Academy  for  any  reason  judged 
to  have  a  significant  motivational  component  are  counted  as  motivatiunal  eliminees.  An  elim¬ 
ination  roster  as  of  August  1961  was  the  basis  for  this  criterion.  Thus  early  eliminees  are 
con.sidered  to  be  those  eliminated  during  the  year  following  admission  to  the  Academy. 


4.  RESl Ii;i S  AND  CONC! .1 ISIONS 

Details  of  the  validation  analyses  and  tables  of  results  are  presented  in  the  Appendix. 
Briefly,  the  following  conclusions  may  be  drawn: 

1.  Few  statistically  significant  changes  in  validity  are  seen  between  the  classes 
of  1963  and  1964  in  tests  common  to  both.  No  significant  changes  ar-  .sicn  in  the  validi¬ 
ties  of  tests  or  other  measures  actually  used  in  selection.  The  statistically  nonsignificant 
changes,  however,  are  in  a  downward  direction  in  most  cases. 

2.  Changes  in  means  and  standard  deviations  between  the  'wo  classes  .suggest  that 
the  self-selection  process  among  potential  candidates  may  still  be  increasing  somewhat  in 
rigor  with  respect  to  nearly  all  areas  of  selection  testing. 

3.  The  formerly  observed  unstable  validities  against  the  academic  criterion  and  the 
CER  have  become  stable,  possibly  as  an  effect  of  stabilized  content  and  methods  in  the 
Academy  curriculum. 


'  Beginning  with  admission  of  the  class  of  196^,  this  criterion  was  superseded  by 
the  Military  Rating. 
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4.  The  selection  tests  continue  to  have  relatively  high  validities  for  the  criteria  they 
are  intended  to  predict.  Hach  criterion  is  predictable  by  at  least  one  selection  variable.  The 
best  single  predictors  of  the  Academic  Standard  .Score,  the  Extracurricular  Activities  Standard 
Score,  and  the  Nonacademic  .Standard  Score  are  found  in  the  selection  battery.  (Table  1) 

5.  All  criteria  are  predictable  by  more  than  one  experimental  test.  The  best  single 
predictors  of  the  CER,  Residualized  CER,  and  Early  Motivational  Elimination  are  in  the  ex¬ 
perimental  battery.  Differences  in  validity  between  the  best  selection  and  experimental  tests 
for  a  given  criterion  are  small,  except  where  the  Academic  Standr.rd  Score  is  the  criterion. 
(Table  2) 

6.  Intercorrelations  of  the  criteria  are  low  where  independence  of  the  criteria  can  be 
reasonably  expected  from  their  definitions.  Correlations  arc  fairly  high  among  most  other 
criteria.  The  correlation  between  the  CER  and  Residualized  CER  is  very  high.  (Table  3) 

7.  The  aptitude  composites  of  the  AFOQT  make  a  unique  and  valid  contribution  to  the 
predicted  variance  in  the  Academic  .Standard  .Score  in  the  context  of  several  other  predictors 
chosen  primarily  from  the  selection  battery.  (Table  4) 

8.  The  PAE  makes  a  unique  and  valid  contribution  to  the  predicted  CER  variance  in 
several  contexts  of  other  predictors,  but  not  in  all  contexts  studied.  The  PAE  and  other 
tests  in  combination  make  a  contribution  in  some  contexts,  but  not  in  all.  The  HSAl  total 
score  makes  a  contribution  to  the  predicted  CER  variance  in  the  contexts  in  which  it  was 
studied.  The  CPI-ASM  sub-battery  also  makes  such  a  contribution.  Selected  AFOQT  aptitude 
composites  do  not.  (Tables  5,  6) 

9.  The  CPI-ASM  sub-battery  and  the  HSAI  total  score  each  separately  make  a  contribu¬ 
tion  to  the  predicted  variance  in  the  Residualized  CER  in  the  same  contexts  in  which  they 
contributed  to  prediction  of  the  original  CER.  The  selected  AFOQT  composites  do  not  so 
contribute.  (Tables  7,  8) 

10.  A  fairly  extensive  set  of  variables  from  both  the  selection  and  experimental  batteries 
does  not  contribute  to  prediction  of  the  Extracurricular  Activities  Standard  .Score  in  the  context 
of  the  PAE  and  Athletic  Activities  Index.  (Table  9) 

11.  The  CPI-ASM  sub-battery  makes  a  contribution  to  the  prediction  of  the  Nonacademic 
Standard  Score  in  the  context  of  other  academic  and  nonacademic  predictors  from  the  selection 
and  experimental  batteries.  (Table  10) 

12.  The  CPI-ASM  .sub-battery  makes  a  contribution  to  the  prediction  of  Early  Motivational 
Elimination  in  the  context  of  other  academic  and  nonacademic  predictors.  (Table  11) 
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APPI-NniS.  STATiSTICAL  RfOSULTS 


THE  DATA 


Data  from  this  validation  study  are  presented  in  several  tables.  Table  1  shows  the 
mean,  standard  deviation,  and  correlation  of  each  selection  variable  with  each  criterion. 

Table  2  presents  the  corresponding  data  for  each  experimental  variable.  Table  3  presents 
the  distribution  statistics  and  intercorrelations  of  the  criteria. 

The  remaining  tables  show  the  results  of  the  multiple  linear  regression  analyses.  There 
is  a  separate  table  for  each  set  of  analyses  against  a  given  criterion.  Each  such  table  shows 
the  standard  partial  regression  coefficients;  the  multiple  correlation  (R)  between  the  predictors 
and  the  criterion;  and  the  squared  multiple  correlation  (R*).  The  relevant  portions  of  the  zero- 
order  validity  tables  (Tables  1  and  2)  are  reproduced  in  each  regression  analysis  table. 

Where  the  analyses  against  a  given  criterion  permit  the  testing  of  more  than  one  hypothesis, 
a  separate  table  is  provided  summarizing  the  hypotheses  and  the  result  of  testing  them.  Tables 
6  and  8  are  of  thi.s  type.  They  specify  the  liyputheses  in  abbreviated  form,  the  regressions  which 
were  compared  in  testing  the  hypotheses,  the  computed  values  of  and  the  statistical  signifi¬ 
cance  of  the  F  values.  In  abbreviated  form,  the  hypotheses  specify  only  that  certain  predictors 
"make  no  contribution.”  The  term  rnnlrihution.  however,  always  means  unique  and  valid  contri¬ 
bution  to  the  total  predicted  criterion  variance  in  the  context  of  the  subset  of  predictors,  I  wo 
or  more  hypotheses  may  be  identical  except  for  the  specification  of  the  context.  The  context 
can  be  determined  by  noting  the  predictors  included  in  the  subset  used  to  test  the  hypothesis. 

In  the  columns  showing  which  regressions  were  compared,  the  analysis  involving  only  the  subset 
is  always  shown  last. 


Table  1.  Validity  of  Selection  Tests 


PREDICTOR 

AC  AOCM 

C  ER 

CRITERIA 

EXTRA 

RESIO  CURRtC 
CER  ACTIV 

NON 

AC  ADCM 

EARtV 
MOTI  V 

ELIM 

MEAN 

SO 

V- 

•rv.i 

495 

495 

495 

676 

AFOgT  COMPOSITES 

PILOT 

.r 

-.0(. 

-.02 

-.00 

-.0*7 

.04 

14(..2 

28.4 

,NAVlGATOK-Tl  (  M 

.Pi 

-.00 

-.02 

-.0*; 

-.10 

.0(> 

180.6 

24.2 

OFFICER  gi  AI.ITV 

.1* 

-.01 

.ot 

-.0*1 

-.00 

.04 

148.8 

14.' 

VERHAl 

.to 

-.11 

-.0' 

-.0*1 

-.14 

.04 

42.2 

8.5 

QUANTITATIVE 

-.08 

-.OS 

-.0' 

-.10 

.0(. 

46.4 

’.5 

AIRMAN.SHIP 

..M 

-.Ot 

.01 

-.0*1 

-.08 

.04 

467.9 

82.4 

FLYING  INTEREST 

.02 

.0(. 

.0’ 

-.07 

-.01 

.04 

1*1.9 

4.0 

TECHNICAL  INTEREST 

.02 

-.10 

-.10 

-.o<. 

-.10 

.02 

11.4 

4.7 

ADMINISTRATIVE  INT 

-.04 

-.02 

.00 

-.02 

-.04 

-.Of 

4.9 

4.4 

QUANTITATIVE  INT 

.07 

-.10 

-.0' 

-.0*1 

-.12 

-.04 

12.7 

4.0 

HIGH  S(  IKXH.  RANK 

.1! 

.Ot 

.02 

-.01 

.01 

.0<) 

4(.0.' 

‘18.4 

(  El H  tests 

VERHAL  APTITUDE 

.tl 

-.08 

-.04 

-.02 

-.Ot- 

.04 

4*12.0 

(>8.1 

FNtH.ISH  ( OMP 

.tu 

.02 

.04 

-.OS 

-.02 

.04 

40  4.1 

VERHAL  (DMPOSITI 

.t^ 

-.Ot 

.0(1 

-.04 

-.04 

.04 

1184.1 

122.' 

MATH  APTITl  DE 

-.0*1 

-.0' 

-.04 

-.0*1 

.04 

14'.' 

(>1.0 

INTFHMI  DIAri  MATH 

.2H 

-.Oi 

-.04 

-.02 

-.04 

.08 

(>44.0 

'4.1 

Ql  ANT  ( OMPOSiTE 

-.08 

-.0' 

-.04 

-.0' 

.07 

1421.8 

121.2 

PHVSC  IAL  APT  EXAM 

.01 

.2*1 

.00 

.48 

.44 

.0*1 

448.' 

*14.  4 

At  TIVITIES  INDEX 

ATHI.FTU 

-.0' 

.11 

.!»• 

.10 

.4' 

.10 

441.4 

*18.0 

NONATHLFTK 

-It 

.20 

.14 

•  w 

.IK) 

444.4 

*1*1.*) 

EXAMINATION  (  OMP 

.Ml 

.20 

.11 

.21 

.14 

491.4 

44.4 

At.F 

-.r 

.H 

.10 

.01 

.00 

-.02 

18.4 

0.*l 

.Voir. —Minimum  r  lor  / 

■  .01  IS 

.12. 
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Table  2.  Validity  of  Kxprrimrntal  Tp«Ih 


CRITERIA 


PREDICTOR 

AC  AOeM 

CER 

RE5ID 

CEH 

EXTRA 

CliRRtC 

AC  Tl  V 

NON 

AC  AOEM 

EARLY 

MO  Tl  V 

ELIM 

MEAN 

5D 

49'i 

49.5 

49-, 

49.-, 

49', 

6/6 

YEARS  OF  COLLEGE 

-.03 

.12 

.11 

-.05 

.05 

-.01 

0.3 

O.f, 

GORDON  PERS  PROFILE 

ASCENDANCY 

.03 

.09 

.08 

.08 

.11 

.02 

'.4 

4.' 

RESPONSIBILITY 

.Of. 

.08 

.0' 

-.04 

.02 

.12 

5.4 

EMOTIONAL  STABILITY 

.02 

.03 

.03 

-.03 

.00 

.19 

'.3 

5.4 

SOCIABILITY 

-.05 

.08 

.0’ 

.10 

.11 

-.02 

5.(. 

5.2 

TOTAL 

.03 

.12 

.11 

.04 

.11 

.14 

28.0 

11.2 

INTERACTION.  PAL  it  tiPP  RESP 

.Of. 

.14 

.0’ 

.04 

.12 

.15 

4  3  39.<, 

31 '4.1 

EDWARDS  PERS  PREF  SCHED 

ACHIEVEMENT 

.Of. 

.03 

-.02 

.10 

.08 

.03 

r.8 

3.8 

DEFERENCE 

.04 

.00 

.W) 

-.0? 

-.01 

.04 

12.1 

3.8 

ORDER 

.04 

.03 

.0  3 

-.0~ 

-.02 

-.03 

IL’ 

EXHIBITION 

-.0' 

-.01 

.02 

.04 

.02 

.08 

14.5 

3.<, 

AUTONOMY 

-.03 

-.13 

-.12 

-.02 

-.10 

11.2 

4.5 

AFFILIATION 

.fi2 

.10 

.11 

.10 

.1’ 

.00 

13.') 

4.3 

INTRACEPTION 

.03 

-.05 

-.0' 

-.03 

-.05 

.05 

15.5 

5.0 

SUCCOR  ANCE 

.OK 

-.01 

.00 

.01 

.00 

-.'If 

s.f 

t.4 

oominanc:e 

.0' 

.12 

.12 

.02 

.O'l 

.Of 

IH.H 

4.2 

ABASEMENT 

.0  3 

.02 

.02 

-.0  3 

.Of 

1 3.  ' 

i." 

NURTURANCE 

-01 

.0(. 

.Oi, 

.01 

.05 

-.03 

11.1 

5.0 

CHANGE 

.01 

.05 

.08 

-.01 

.00 

1-4.S 

5.0 

ENDURANCE 

.Of, 

.0' 

.,’5 

-.02 

.03 

.03 

14.5 

HETEROSEXUALITY 

.01 

.08 

.08 

.03 

.0' 

.131 

10.') 

5.8 

aggression 

.00 

.05 

.,'■1 

-.01 

.03 

-.02 

lO.-' 

CONSISTENt  Y 

.OS 

.03 

.Of 

-.01 

.01 

.01 

5,  3 

1.9 

SELF  INSIGHT  TEST 

.0  3 

-.Of, 

-.Of. 

.Of, 

.00 

—  .OS 

2^^ 

CADET  PERSONNEL  INVEN 

COMMl’NALITY 

.Of. 

.15 

.12 

.00 

At> 

.12 

A'.s 

5.1 

DEPENOENC  Y 

-.01 

.2  3 

22 

.0’ 

.1(' 

.13 

j-.s 

HETERONOMY 

-.10 

.1  3 

.12 

.w  1 

.11 

.01 

3».5 

(  ER 

-.0» 

.  3” 

.31 

.!'> 

.38 

.11 

10.  3 

s.'  ' 

ANSWER  SHEET  MARKINt. 

.13 

.18 

.1' 

.0' 

.l( 

.i;s 

‘ 

'.s 

OFFU  ER  1  FFI ( T  INVEN 

EDIX  ATIONAI.  SU(  (  ESS 

.2t. 

.0*' 

.08 

.11 

.13 

.03 

4.1 

l.u 

{ T  i  ll  RE 

.04 

-.0.* 

.'i2 

.0(1 

-.01 

1.5 

1.5 

READINC. 

.l!> 

-.08 

-.03 

-.1! 

-.12 

-  .05 

>  •• 

l.f 

LK.HT  LEISURE 

-.04 

-.Of, 

—  .04 

-.0.8 

-.0 

2.ti 

t.f. 

RISK 

.IHl 

.r 

.13 

.14 

.o^ 

12.4 

4.5 

S(K  lAl.l/EO  A(r(.RESSI<»N 

,04 

.2(, 

.2  3 

.IK 

.02 

12.' 

5.1 

OF  Fit  1  R  LFAOFKSHIP 

.10 

.14 

.05 

.|5 

.01 

3'..  ' 

EXTROVERSION 

— 

.21, 

.18 

.20 

.3fl 

f,.0 

>  > 

INTEI.LFT  TUAI  APT 

.13 

-.03 

-.02 

-.0' 

-.0' 

-,,)3 

34.0 

nn  AL 

.11 

-.12 

-.11 

-.13 

-.1; 

-.tH 

3'.2 

11.4 

MS  A<  TIVITIFS  INVENTORY 

ATHI  FTU 

-.02 

.|o 

.3f, 

.40 

Ui. 

.1 

NONATHLi  Tl< 

.15 

.13 

.14 

-04 

12.' 

f..5 

TOTAL 

.os 

.25 

.15 

.2(, 

.33 

.Of, 

19.8 

REVISED  Aim  FIK 

-.C3 

.2f 

.11 

.  31 

.38 

.05 

35.4 

REVISED  NONATHLETK 

.f»s 

.2f. 

>  » 

.38* 

>  > 

.02 

4'.(. 

34.8 

REVISED  TOTAi. 

.02 

.31 

.20 

.2  3 

.3.. 

.04 

H3.0 

5  3.2 

f  ER  PR!  DK  1  (  (»MI' 

.t)f. 

.31 

.14 

.21 

.  33 

.If, 

55H.f. 

53.8 

/  •  »  *>/»  It.  i  •.»!  nr\:  I 
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Table  2  {(.imliniiftl) 


CRITERIA 


PREDICTOR 

AC  AOCM 

cen 

ftCSiO 

CEft 

EXTRA 

CUPRIC 

AC  T|  V 

NON 

AC  ALiE'4 

E  arl  V 

MO  T  V 

tUlM 

MEAN 

SD 

(  ()l.()R-K)RM 

COl.OR-FORM  A 

.or. 

-.01 

-.01 

-.01 

-.01 

-.ol 

I2.S 

2.  1 

(  ()I.(»R-K)KM  H 

.'K. 

.01 

.01 

.01 

.0. 

o' 

lr..l 

1.1. 

(  <)I.OR-K)RM  <; 

.1(1 

.11 

.12 

.02 

21.2 

2.1. 

DKSIGN  PRI.FFRi;Nt  1  11  ST 

-.(IH 

.02 

.02 

-.02 

.(K) 

.IM) 

2S.  1 

S.O 

IX)T  KSTIMATION 

•  K. 

.IS 

.1  1 

.0' 

.11 

.01 

I.S.H 

11.1 

tORI)  KNOUT. i  lH.K 

.Ill 

.or. 

.OS 

.  10 

.0' 

Sl.l 

2.1 

Sf  ;.F  (  RKDITINt.  TI  .ST.  NUM 

ABILITY  A 

.10 

-.0' 

-.0' 

.(>(< 

-.01 

.1. 

•I.  1 

1.0 

ABILITY  B 

.11 

.02 

.01 

.02 

.01 

-.1.; 

1 

>  > 

ABILITY  ( 

.10 

.01 

.02 

— .()» 

-.02 

-.0  >. 

>  > 

TOTAL  ABII.ITV 

1 » 

.IM) 

.01 

.01 

.01 

-.o: 

21. s 

1.1 

RISK  A 

.02 

-.0' 

-.0*) 

-.0' 

.00 

-.02 

l.O 

0.  1 

RISK  B 

.0*) 

-.OS 

-.()•) 

.01 

-.OS 

-.Oh 

i.i 

0.' 

RISK  f 

.01 

-.O*) 

-.0‘> 

-.01 

-.0' 

-.()(. 

•l.i! 

1.2 

TOTAL  RISK 

.o.| 

-.10 

-.11 

.01 

-.Or 

-.0' 

1  l.s 

1.0 

Nntr. -Mi,nitnum  r  for  /’  ,01  in  .12. 


.'m<M)R|)bR  VAl. 11)1111  S 

le  ha.s  been  pointed  tnit  in  previous  r-ports  (.Miller.  l%0b;  Oea/ter  &  .Miller,  1960;  .Miller 
A  (;rea>!er,  1%'1;  .Miller,  l%i)  that  the  history  ot  the  testing  program  at  the  .Air  Force  .Academy 
h.is  shown  a  generally  declinine  trend  in  the  validities  of  tests  from  year  to  year,  starting  from 
extremely  high  validities  in  the  class  of  I9A9.  Thi.s  decline  is  best  obseived  in  the  selection 
tests  because  these  contain  the  only  scales  administered  to  all  classes.  The  declining  trend 
usually  has  been  attributed  to  oicreasingly  rigorous  selection  requirements,  with  resulting 
increase  in  the  severitv  of  the  test  range  restriction.  .An  additional  factor  tending  to  produce 
the  same  effect  is  an  increase  in  the  rigor  of  self-selectiiMi  among  potential  candidates  as  the 
realities  of  academic  and  miliia<y  life  at  the  .Academy  become  more  widely  known.  ('oun.splir,|( 
materials  prepared  by  the  Academv  for  potential  candidates  have  probably  encouraged  this 
self-scIcs tion  process. 

Hv  the  time  the  validation  study  for  the  class  of  196^  was  accomplished,  it  appeared  that 
the  downward  trend  in  validities  had  virtually  ceased  (.Miller.  10(>I).  (  omparisons  of  the  classes 
of  l'X>^  and  l*X>-t  in  terms  of  tests  lomrmwi  to  both  suggest  that  the  downward  trend  remains  es¬ 
sentially  arrested.  TTie  tests  c<Mnm>>n  to  both  classes  are  the  selection  tests  and  four  of  the  ex- 
peiimental  measures  (Years  of  (  ollege.  IIS.AI.  OKI.  and  .'^If  Insight  Test).  While  minor  flaciua- 
tiiMis  in  validities  are  noted  in  most  of  these  common  measures  {torn  one  class  to  the  other,  the 
differences  arc  generally  not  statistically  significant.  Significance  tests  were  applied  bv  con¬ 
verting  validity  t »*efficienis  in  b**ih  classes  to  Kistier  -■  coefficients  and  testing  the  differences 
bciwern  v  orresporitfing  rs.  The  only  test  scale  whose  validity  shifted  downward  at  the  .01  level 
of  signtfic.ince  was  the  .A1(K2T  .Aikninisuative  Interest  composite  for  the  prediction  of  the  .Aca¬ 
demic  Standard  Store  <.*  '.0').  Two  other  validities  shifted  to  an  extent  which  was  significant 

ai  the  .0'  level  but  n«w  ar  the  .01  level.  These  were  for  Age  and  Years  of  (  ollege  as  predictors 
of  the  Academic  .Standard  Score  (r  2.09  in  both  cases).  TT»ese  dcmhtfullv  significant  changes 


il 


Tahir  InU'rciirri'liilMiii  of  (Til<‘riu 

(N  m) 


CRITERION 

1 

2 

3 

4 

MEAN 

SO 

1 

Academic  .Standard  Score 

^10.4 

90.1 

2 

(  adet  Fffectiveness 

Rating 

.18 

A0A.8 

97.) 

i 

Re*  iuuali/ed  (  adet 

Fffectiveness  Rating 

.19 

.% 

*>00.0 

9).l 

Fxtracurricular  .Activities 

•Standard  .Score 

.02 

.18 

.07 

498.) 

98.7 

Nonacademic  Standard 

•Score 

.12 

.76 

.69 

.77 

1004.1 

IA0.6 

6 

Farly  Motivational 

Klimination  (N  616) 

0.8 

0.4 

were 

in  opposite  directions.  None  of  the 

scores  actually  used  in 

select 

ing  the  clas 

s  of  1964 

showed  a  significant  chang<  in  validity  against  either  the  academic  average  or  the  (!KR.  the 
ciiteria  common  to  this  class  and  the  class  of  1%^.  However,  most  of  the  nonsignificant 
validity  fluctuations  in  the  selection  and  experimental  batteries  were  in  a  downward  direction. 

When  means  and  standard  deviations  of  tests  common  to  the  classes  of  196i  and  1964 
are  compared,  the  means  in  the  class  of  1964  tend  to  be  higher  and  the  standard  deviations 
tend  to  be  smaller  than  in  the  class  of  196^.  The  formal  requirements  for  selection  in  the  two 
classes  are  identical,  both  with  respect  to  qualifying  scores  and  weights  in  the  Examination 
(  ompoMte.  The  increase  in  range  restriction  is  therefore  best  interpreted  as  evidence  that 
self-selection  still  tends  toward  somewhat  increased  seventy,  apparently  in  practically  all 
areas  of  selection  testing. 

Kven  while  the  selectiiwi  requirements  and  the  self-selection  process  became  increasingly 
rigt>rous  across  several  earlier  classes,  a  tendency  existed  for  the  same  predictors  to  fluctuate 
markedly  in  validity  from  one  class  to  the  next  (Oeager  &  Miller.  I960.  .Miller  &  (.reager,  1960; 
Miller.  I9(>l).  The  fluctuations  were  most  noticeable  when  individual  course  grade.s  were  used 
as  criteria,  but  they  were  also  observable  in  the  academic  average  and  ihe  CFR.  It  is  a|^ient 
that  these  excessive  fluctuations  are  no  longer  seen  for  criteria  common  to  the  present  and 
earlier  studies.  The  explanation  cannot  be  given  in  terms  of  the  selection  process.  While  the 
av.tilable  data  do  r»ot  provide  an  explanation,  it  is  reasonable  to  suppose  that  experience  with 
early  clas.%es  has  led  to  relatively  enduring  decisions  about  course  content,  methods  of  presen¬ 
tation.  and  techniques  of  evaluation.  .Stability  of  this  sort  should  tend  to  stabilixe  the  predictor 
validities. 

The  selection  tests  continue  to  show  relatively  high  validities  for  the  criteria  they  were 
intended  to  predict.  Kach  criterion  is  predictable  horn  at  least  one  of  the  selection  variables. 
Kach  criterion  is  also  predictable  from  various  experimeotai  tests.  The  best  single  predictor 
of  the  Academic  Standard  Score  is  the  Kxamination  C.oaqwsite,  while  the  best  predictor  of  both 
the  Kxuacunicular  Activities  Stwtdard  Score  and  die  Nonacademic  Standard  Score  is  the  Athletkc 
Activities  Index.  These  predictors  belong  to  the  selection  battery.  On  the  other  hand,  the  best 
single  predictor  of  the  (  HR  and  the  Residualixed  C.FR  is  the  (  FR  scale  of  the  Cadet  Personnel 
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Inventory,  while  the  best  preilittor  of  Marly  Motivational  Mlimination  is  the  Mmotional  Stability 
scale  <if  the  (tonlon  Petsonal  Profile.  Differences  between  the  best  selection  an«l  s**perimental 
predictors  are  slight,  however,  except  in  the  prediction  of  the  Academic  Standard  Score,  hew 
of  the  experimental  tests  were  expected  to  have  validity  for  this  criterion.  Most  scales  of  the 
commercial  tests  were  not  valiii  for  .iny  criterion. 

(Criterion  intercorrelations  in  Table  <  show  a  satisfactory  decree  of  independence  of 
the  criteria  where  independence  is  to  be  expected.  A  fairlv  high  correlation  exists  between 
the  Nonacademic  Standard  Score  Jnd  both  the  (  KK  and  the  l-ixtracurricular  Activities  Standard 
■Score,  but  this  is  because  the  Nonacademic  Standard  Score  is  merely  the  sum  of  the  other  two. 
There  is  also  a  high  correlation  between  the  Nonacademic  Standard  Score  and  the  Residuali/ed 
(d'iR,  which  in  turn  has  a  very  high  correlation  with  the  original  (d-!R.  Other  correlations  in 
the  table  are  low.  A  value  of  SOO.O  was  arbitrarily  added  to  the  computed  mean  of  the  Resid- 
uali/ed  (  MR  to  yield  a  mean  comp.irable  to  those  of  the  other  standard  score  criieri.i. 


RU.KI  sSlON  A\AI  VSJ  S 
PrrdieiioR  of  the  \eu«leiNie  Sandurd  N-ore 

Table  f  presents  the  results  of  regression  an.ilvses  against  the  .Academic  Stand.ud  score. 
Kntries  in  columns  .A  and  H  are  beta  weight*  associated  with  the  predictors  m  the  two  an.ilvses 
performed.  PredictiHs  were  chosen  to  test  the  hypothesis  that  the  aptitude  composites  of  the 
AFOQT  do  not  make  a  unique  and  valid  contribution  to  the  predicted  .Acaviemu  Stan  !.ird  Sci'te 
variance  in  the  cimtext  of  several  other  predictors,  mostiv  from  the  selection  b.itterv. 


Tahlf  t.  Ke|{res><ion  Nnulvsis  XgaiRst  XeMdemie  Mandard  N-ori 

(N 


PREDICTOR 

VAL  ipl  Tt 

A 

B 

.AFOyT  Pilot  <  omposi'e 

.r 

.00 

.AF<.)yT  Navigator-Technical  (  omposue 

.  (S 

.00 

AFOyT  Officer  (^hiality  <  omposnr 

.I" 

.AFOQT  Verbal  (  omposue 

.  AO 

.AFOf^T  (^antitaiive  <  omposite 

.1' 

.10 

.AFO(j>T  .Airmanship  (  omp«>sue 

..M 

.0-4 

High  School  Rank 

.tl 

.;s 

.AU 

MFFH  Verbal  Aptitude 

.  A1 

.11 

.!(> 

(  FFH  Flngiish  (  «>fflposi(ion 

,  AO 

It 

.|A 

(  FFH  Mathematic  s  .Aptitu-ie 

.AS 

.00 

It 

(  FFH  Intermediate  Mathematics 

.:h 

.08 

It. 

.Athletic  -Activities  Index 

-  .OS 

UA 

OA 

Nonalhleiic  .Activities  Index 

.1  A 

i; 

i: 

Age 

.1' 

!•> 

-.:o 

Years  of  <  tdlege 

-UA 

.08 

.1  A 

R' 

to:  A 

.  AS'n 

R 

I.A 

(d) 

I  < 


Results  of  testing  this  hypothesis  suppoa  the  conclusion  that  the  AFOQT  aptitude  com¬ 
posites  do  make  a  unique  and  valid  contribution  to  prediction  of  the  Academic  Standard  Scoie 
when  added  to  a  combination  of  predictors  consisting  of  High  School  Rank,  the  four  CKRB  tests, 
the  two  Activities  Indexes,  Age,  and  Years  of  College.  Thus  the  hypothesis  is  rejected.  Com¬ 
putation  of  the  F  statistic  used  in  testing  the  hypothesis  takes  account  of  the  fact  that  the 
Airmanship  composite  is  determined  by  a  linear  combination  of  the  Pilot,  Navigator-Technical, 
and  Quantitative  composites.  The  obtained  value  of  I  is  7.15. 

Prediction  of  the  (iadet  Kffectiveness  Rating 

Table  5  shows  the  results  of  the  several  regression  analyses  performed  against  the  CKR 
as  the  criterion.  The  analyses  permit  the  testing  of  14  hypotheses.  These  hypotheses  arc 
stated  in  abbrevii  ed  form  in  Table  6,  along  with  the  results  of  the  hypothesis  tests. 

It  has  been  observed  previously  that  the  PAL  is  a  t  insistently  valid  predictor  of  the  CER, 
and  that  it  makes  a  unique  and  valid  contribution  in  a  variety  of  contexts  of  other  tests,  though 
not  in  all  contexts  studied  (Creager  &  Miller,  1961).  Data  in  Table  6  indicate  that  the  PAE  does 
not  make  a  contribution  when  added  to  a  combination  of  other  predictors  consisting  of  selected 
A.POQT  composites,  High  School  Rank,  the  two  Activities  Index  scores.  Age,  Years  of  College, 
and  the  CPl-ASM  sub-battery.  Nor  does  the  PAE  contribute  when  the  AEOQT  composites  are 
removed  from  this  context.  However,  the  PAE  docs  contribute  when  the  AEOQT  composites 
are  restored  and  the  CPI-ASM  sub-battery  is  simultaneously  removed.  The  PAE  also  contributes 
when  added  to  High  School  Rank  and  the  CEEB  composites,  and  to  these  plus  the  HS.Al  total 
score.  In  general,  the  PAE  makes  a  unique  and  valid  contribution  in  several  contexts,  but  not 
in  all  contexts  containing  other  valid  predictors  of  the  CER.  This  point  may  have  practical 
significance,  since  the  contextual  predictors  are  cheaper  and  more  easily  administered  than 
the  PAE, 

When  the  PAE  and  selected  AEOQT  composites  aie  treated  as  a  single  set  of  predictors, 
they  fail  to  make  a  contribution  when  added  to  High  School  Rank,  the  two  Activities  Index  scores. 
Age,  Years  of  College,  and  the  CPI-ASM  sub-battery.  The  PAE  and  CPl-ASM  sub-battery  together 
do  make  a  contribution  in  a  context  of  selected  AEOQT  composites.  High  School  Rank,  the  Activ¬ 
ities  Index  scores.  Age,  and  Years  of  College.  The  PAE  and  HSAI  total  score  together  contribute 
in  the  context  of  High  School  Rank  and  the  CEEB  composites. 

The  HSAI  total  score  alone  contributes  in  the  context  of  High  School  Rank  and  the  (J-HvB 
composites,  and  in  this  context  plus  the  PAE.  The  selected  AEOQT  composites  fail  to  contribute 
when  added  to  a  context  composed  of  High  School  Rank,  the  PAE!,  the  Activities  Indexes,  .Age, 
Years  of  College,  and  the  CPI-ASM  sub-battery.  The  AEOQT  composites  still  do  not  contribute 
when  the  PAE  is  removed  from  this  context.  The  (T’l-A.SM  sub-battery,  on  the  other  hand,  docs 
contribute  when  added  to  the  selected  AEOQT  composites.  High  School  Rank,  the  Activities 
Indexes,  Age,  and  Years  of  College.  This  sub-battery  continues  to  contribute  when  the  PAE  is 
added  to  the  context. 

I’redielion  of  the  Residual i/ed  (iudel  |^ffeeti^eness  Ruling 

The  regression  analyses  performed  using  the  Residualized  CER  as  the  criterion  are  shown 
in  'I'able  7.  These  analyses  permit  te.sting  of  three  hypotheses  shown  in  abbreviated  form  in 
Table  8.  Ihesc  hypotheses  parallel  three  of  the  hypotheses  concerning  prediction  of  the  original 
C1;R,  both  with  respect  to  the  predictors  under  study  and  the  contexts. 

Results  of  testing  these  hypotheses  indicate  that  the  AEOQT  composites  studied  do  not 
contribute  to  prediction  of  the  Residuali/ed  ChiR  in  the  context  of  High  .School  Rank,  the  Activ¬ 
ities  index  scores.  Age,  Years  of  (x.ilegc,  and  the  (.PI-ASM  sub-battery.  However,  the  (. PI-ASM 
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Table  .5.  KegrrsNi»n  Analysis  Against  Cadet  effectiveness  Rating 


(N=495) 


PREDICTOR 

VALIDITY 

A 

b 

C 

E 

F 

G 

H 

1 

J 

AFOQT  Pilot  C'ompoiite 

-.Ot^ 

-.05 

-.08 

•  .. 

-.23 

-.24 

.  . 

.  . 

.  • 

•  • 

AFOQT  Navigator-Technical  Comp 

-.06 

-.01 

-.01 

-- 

-- 

-.13 

-.14 

-- 

-- 

-• 

-- 

AFOQT  Airmanship  Composite 

-.03 

.08 

.11 

-- 

-- 

.34 

.34 

-- 

-- 

-- 

-- 

High  School  Rank 

.03 

.00 

.00 

.00 

.00 

.02 

.02 

.00 

.00 

.03 

.04 

Verbal  Composite 

-.03 

-- 

-- 

-• 

-- 

-- 

.. 

.03 

.02 

.02 

.00 

CKKB  Quant  Composite 

-.08 

-- 

-- 

-- 

-- 

-- 

-- 

-03 

-.04 

-.05 

-.09 

PAE 

.29 

.10 

-- 

.10 

-- 

.14 

.22 

.28 

Athletic  Activities  Index 

.31 

.12 

.18 

.12 

.17 

.20 

.27 

Nonathletic  Activities  Index 

.29 

.19 

.19 

.19 

.19 

.22 

.22 

Age 

.13 

.05 

.06 

.05 

.06 

.09 

.10 

Years  of  College 

.12 

.06 

.05 

.06 

.06 

.09 

.10 

(.PI  Communality 

.15 

.06 

.07 

.05 

.07 

-- 

CPI  Dependency 

.23 

.03 

.02 

.03 

.03 

-- 

CPI  Heteronomy 

.13 

-.01 

-.01 

-.01 

-.01 

-• 

CPI  CER 

.39 

.22 

.24 

.23 

.24 

•• 

Answer  Sheet  Marking 

.18 

.12 

.11 

.12 

.12 

-- 

— 

-- 

-- 

HSAI  Total 

.25 

-- 

-- 

-- 

-- 

-- 

.17 

.25 

R2 

.2630 

.2581 

.2604 

.2546 

.2005 

.1879 

.1071 

.0625 

.0656 

.0080 

R 

.51 

.51 

.51 

.50 

.45 

.43 

.33 

.26 

.29 

.09 

Table  6.  Tests  of  Hypotheses  (Data  from  Table  5) 


HYPOTHESIS 

REGRESSIONS  COMPARED 

F 

P 

1 

PAE  makes  no  contribution 

A 

and  B 

3.19 

>.05 

2 

Selected  AFOQT  composites  make  no 
contribution 

A 

and  C 

0.56 

>.05 

3 

PAE  and  selected  AFOQT  composites 
make  no  contribution 

A 

and  D 

1.37 

>.05 

4 

CPI-ASM  sub-battery  makes  no 
contribution 

A 

and  E 

8.14 

<.01 

5 

PAE  and  CPI-ASM  sub-battery 
make  no  contribution 

A 

and  F 

8.15 

<.01 

6 

Selected  AFOQT  composites  make 
no  contribution 

B 

and  D 

0.76 

>.05 

7 

('PI-ASM  sub-battery  makes  no 
contribution 

B 

and  F 

9.10 

<.01 

8 

PAE  makes  no  contribution 

C 

and  D 

3.79 

>.05 

9 

PAE  makes  no  contribution 

E 

and  F 

7.64 

<.01 

10 

PAEi  makes  no  contribution 

G 

and  H 

22.89 

<.01 

11 

HSAI  total  score  makes  no 
contribution 

G 

and  I 

11.78 

<.01 

12 

PAE  and  HSAI  total  score  make 
no  contribution 

G 

and  J 

27.14 

<.01 

13 

HSAI  total  score  makes  no 
contribution 

H 

and  J 

30.04 

<.01 

14 

PAE  makes  no  contribution 

I 

and  j 

41.58 

<.0I 

15 


Table  7.  Krgrt'HHion  AnalyniH  Against  RrHidualizcd 
(ladn  KffrrtivcnrHH  Rating 


(N  -  495) 


PREDICTOR 

VALIDITY 

A 

B 

C 

E 

AFOQT  Pilot  Composite 

-.02 

-.08 

-.25 

AFOQT  Navigator-Technical 
Composite 

-.02 

-.01 

-.15 

-  . 

AF'OQT  Airmanship  Composite 

.01 

.11 

-- 

.35 

-- 

-- 

High  School  Rank 

.02 

.00 

.00 

.02 

.00 

.04 

C^FEB  Verbal  (Composite 

.00 

-- 

-- 

.02 

.00 

CEEB  Quantitative  Composite 

-.05 

-- 

-- 

-- 

-.04 

-.09 

Athletic  Activities  Index 

.16 

.17 

.16 

.26 

-- 

Nonathletic  Activities  Index 

.26 

.20 

.19 

.24 

-- 

Age 

.10 

.05 

.05 

.10 

-- 

Years  of  College 

.11 

.08 

.10 

.11 

-- 

CPI  Communality 

.12 

.07 

.06 

-- 

-- 

CPI  Dependency 

.22 

.03 

.03 

-- 

-- 

CPI  Heteronomy 

.12 

-.01 

-.01 

-- 

-- 

CPI  CER 

.31 

.24 

.24 

-- 

-* 

Answer  Sheet  Marking 

.17 

.11 

.12 

-- 

-- 

-- 

HSAI  Total 

.15 

-- 

.24 

-- 

R* 

.2028 

.1984 

.1380 

.0380 

.0053 

R 

.45 

.45 

.37 

.19 

.07 

Table  8.  TfNln  of  Hypolhrurs  (Data  from  Table  7} 


HYPOTHESIS 

REGRESSIONS  COMPARED 

F 

P 

1  Selected  AFOQT  composites  make 

no  contribution 

A  and  B 

0.88 

>.05 

2  CPl-ASM  sub-battery  makes  no 

contribution 

A  and  C 

7.82 

<.01 

3  HSAI  total  score  makes  no 

contribution 

D  and  E 

16.66 

<01 
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sub-battery  does  contribute  in  a  context  of  selected  AFOQT  composites,  High  School  Rank, 
the  Activities  Index  scores.  Age,  and  Years  of  College.  Further,  the  HSAl  total  score  con¬ 
tributes  in  the  context  of  High  School  Rank  and  the  CEEB  composites.  The  conclusions 
concerning  each  of  the  three  hypotheses  are  identical  with  those  for  the  parallel  hypotheses 
pertaining  to  the  original  CER  as  the  criterion. 

Prediction  of  the  Extracurricular  Activities  Standard  Score 

Prediction  of  the  Extracurricular  Activities  Standard  Score  by  regression  methods  is 
shown  in  Table  9.  The  only  analysis  initially  performed  against  this  criterion  was  the  one 
shown  in  column  A  of  the  table.  Its  purpose  was  merely  to  determine  the  multiple  validity 
coefficient  of  a  fairly  extensive  group  of  predictors  when  this  criterion  was  used.  By  inspec¬ 
tion,  it  appeared  that  only  two  of  the  predictors,  the  PAE  and  Athletic  Activities  Index,  ac¬ 
counted  for  nearly  all  the  predicted  criterion  variance.  One  additional  analysis  was  then 
performed  to  test  the  hypothesis  that  the  group  of  predictors  other  than  the  PAE  and  Athletic 
Activities  Index  does  not  make  a  contribution  when  these  two  predictors  constitute  the  con¬ 
text.  A  test  of  this  hypothesis  supported  the  conclusion  that  the  predictors  do  not  contribute 
in  the  context  of  the  PAE  and  Athletic  Activities  Index.  The  value  of  F  is  0.55. 


Table  9.  Regreaaion  Analysis  Against  Extracurricular 
Activities  Standard  Score 

(N=495) 


PREDICTOR 

VALIDITY 

A 

B 

AFOQT  Pilot  Composite 

-.09 

.00 

-- 

AFOQT  Navigator-Technical  Composite 

-.09 

.03 

-- 

AFOQT  Airmanship  Composite 

-.09 

.00 

-- 

High  School  Rank 

-.01 

-.04 

-- 

PAE 

.38 

.23 

.23 

Athletic  Activities  Index 

.40 

.27 

.28 

Nonathletic  Activities  Index 

.13 

.05 

Age 

.01 

.02 

Years  of  College 

-.05 

-.06 

CPI  Communality 

.00 

-.04 

CPI  Dependency 

.02 

-.04 

CPI  Heteronomy 

.04 

.05 

CPI  CER 

.19 

.01 

Answer  Sheet  Marking 

.07 

.04 

R* 

.2128 

.2020 

R 

.46 

.45 

Prediction  of  the  Nonacademic  Standard  Score 

Results  of  the  regression  analyses  using  the  Nonacademic  Standard  Score  as  the  criterion 
are  shown  in  Table  10.  The  two  analyses  against  this  criterion  were  designed  to  test  the  hy¬ 
pothesis  that  the  CPI-ASM  sub-battery  makes  no  contribution  in  the  context  of  selected 
AFOQT  composites.  High  School  Rank,  the  PAE,  the  two  Activities  Indexes,  Age,  and  Years 
of  College.  It  is  concluded  that  the  CPI-ASM  .sub-battery  does  make  a  unique  and  valid  c  xi- 
tribution  in  this  context.  This  conclusion  is  based  on  a  significant  computed  F  value  of  4.77. 
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Table  10.  KegreiHHion  AnalyHin  Against  Nonacademir  Standard  Score 


(N=495) 


PREDICTOR 

VALIDITY 

A 

B 

AFCX^T  Pilot  Composite 

-.09 

-.01 

-.10 

AFOQT  Navigator-Technical  Composite 

-.10 

.00 

-.02 

AFOQT  Airman.ship  Composite 

-.08 

.05 

.12 

High  School  Rank 

.01 

-.02 

-.01 

PAE 

.44 

.21 

.24 

Athletic  Activities  Index 

.47 

.26 

.31 

Nonathletic  Activities  Index 

.27 

.16 

.17 

Age 

.09 

.05 

.08 

Years  of  College 

.05 

-.01 

.00 

CPI  Communality 

.10 

.00 

CPI  Dependency 

.16 

.00 

-- 

CPI  Heteronomy 

.11 

.02 

-- 

CPI  CER 

..58 

.16 

Answer  Sheet  Marking 

.16 

.11 

-- 

R* 

.3373 

.3044 

R 

.58 

.55 

Prediction  of  Karly  Motivational  Elimination 

Table  11  presents  the  results  of  analyses  using  Early  Motivational  Elimination  as  the  cri- 
teiion.  Again  two  analyses  were  performed,  and  one  hypothesis  was  tested.  The  hypothesis  is 
that  the  CPI*ASM  sub-battery  makes  no  contribution  in  a  context  identical  with  that  involved  in 
the  prediction  of  the  Nonacademic  Standard  Score.  The  conclusion  is  that  the  (^PI-ASM  sub¬ 
battery  does  make  a  unique  and  valid  contribution  in  the  .specified  context.  Ihe  value  of  F  is  4.10. 


Table  ll.  KegreHMiun  AnalyHiis  Againni  Early  Mtitivatiunal  Elimination 

(N  -  616) 


PREDICTOR  VALIDITY  A  B 


AFOQT  Pilot  Composite 
AFOQT  Navigator-Technical  Composite 
AFOQT  Airmanship  C;omposite 
High  School  Rank 

paf: 

Athlet  ir  Activities  Index 
Nonathletic  Activities  Index 
Age 

Years  of  (College 
CPI  Commur.ality 
(!PI  Dependency 
('PI  Heteronomy 
CPI  CKR 

Answer  Sheet  Marking 
R* 

R 


.05 

.02 

.02 

.06 

.07 

.07 

.05 

.00 

.00 

.06 

.05 

.04 

.09 

.02 

.04 

.10 

.10 

.11 

.00 

-.07 

-.04 

-.02 

.00 

.00 

-.01 

-.03 

-.02 

.12 

.08 

.13 

.13 

.01 

-.08 

.11 

.04 

.08 

.06 

.0549 

.0227 

.23 

.15 
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